Monitoring Data Quality for Very High Volume
نویسندگان
چکیده
In this paper we describe a new methodology for detecting data quality problems in high volume transaction streams called change detection using cubes of models or CDCM. We also describe how this system is deployed at Visa and two case studies that occurred during its first year of operation. ∗This work was supported in part by the Visa International Data Interoperability Program and the U.S. Army Pantheon Project. †Robert Grossman is the corresponding author. He is also a faculty member at the University of Illinois at Chicago.
منابع مشابه
Online Monitoring for Industrial Processes Quality Control Using Time Varying Parameter Model
A novel data-driven soft sensor is designed for online product quality prediction and control performance modification in industrial units. A combined approach of time variable parameter (TVP) model, dynamic auto regressive exogenous variable (DARX) algorithm, nonlinear correlation analysis and criterion-based elimination method is introduced in this work. The soft sensor performance validation...
متن کاملCapabilities of data assimilation in correcting sea surface temperature in the Persian Gulf
Predicting the quality of water and air is a particular challenge for forecasting systems that support them. In order to represent the small-scale phenomena, a high-resolution model needs accurate capture of air and sea circulations, significant for forecasting environmental pollution. Data assimilation is one of the state of the art methods to be used for this purpose. Due to the importance of...
متن کاملCapabilities of data assimilation in correcting sea surface temperature in the Persian Gulf
Predicting the quality of water and air is a particular challenge for forecasting systems that support them. In order to represent the small-scale phenomena, a high-resolution model needs accurate capture of air and sea circulations, significant for forecasting environmental pollution. Data assimilation is one of the state of the art methods to be used for this purpose. Due to the importance of...
متن کاملPalarimetric Synthetic Aperture Radar Image Classification using Bag of Visual Words Algorithm
Land cover is defined as the physical material of the surface of the earth, including different vegetation covers, bare soil, water surface, various urban areas, etc. Land cover and its changes are very important and influential on the Earth and life of living organisms, especially human beings. Land cover change monitoring is important for protecting the ecosystem, forests, farmland, open spac...
متن کاملFormation of a deep pit lake: case study of Aguas Claras, Brazil
The paper presents the case study of the current formation of a Brazilian pit lake from an iron ore mining activity. The water used for the filling of the lake comes from rain, ground water and the complementary pumpage from a close river. At its final stage, which will be reached around year 2018, Lake Aguas Claras will have a surface area of 0.67 km2 and the depth of 234 m, which will make it...
متن کامل